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INTRODUCTION 


Since the first modern-day voucher program launched in Milwaukee in 1990, researchers have studied 
private school choice programs. Few American education reforms, it seems, have been studied as much 
as choice. And even fewer, if any, have such a broad array of possible outcomes for students, schools, 
taxpayers and families. 


Researchers from across the country have published more than 140 empirical studies on the 
effectiveness of these programs. And for most, that may seem an overwhelming amount of literature to 
tackle. That’s why we are excited to bring you the first edition of The 123s of School Choice, an annually 
updated review of the available research on private school choice programs in America. 


The first set of outcomes we cover are studies of the personal benefits that families can gain from 
participating in private school choice programs. These include: 


¢ Program Participant Test Scores: These studies examine whether students who receive and/or 
use scholarships to attend a private school of their choice achieve higher test scores than students 
who applied for, but did not receive or use scholarships. 


¢ Program Participant Attainment: These studies examine whether school choice programs 
have an effect on students’ likelihood to graduate high school, enroll in college or attain a college 
degree. 


¢ Parent Satisfaction: These studies rely on polling and surveys to measure the extent to which 
parents with children participating in private school choice programs are satisfied with their 
current school compared to their pre-program school or to non-program students. 


The second set of outcomes we cover are studies of the benefits that communities and society can gain 
from these programs. These include: 


¢ Public School Students’ Test Scores: These studies examine whether students who leave public 
schools by using a private school choice program have an effect on the test scores of students who 
remain in public schools. 


¢ Civic Values and Practices: These studies examine whether school choice programs have an 
effect on students’ tolerance for the rights of others, civic knowledge, engaging in criminal activity, 
civic participation, volunteerism, social capital, civic skills, voter registration, voter turnout as 
well as patriotism. 


¢ Racial/Ethnic Integration: These studies examine the effect of private school choice programs 
on racial and ethnic diversity in schools. 


¢ Fiscal Effects: These studies examine whether school choice programs generate net savings, net 
costs or are cost-neutral for taxpayers. 
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We recognize that interpreting research findings is challenging. What constitutes a meaningful 
effect? Is a statistically significant finding educationally significant? How do we aggregate findings of 
programs that superficially look like one another but are actually quite different at the ground level? 
Scholars and advocates have debated and will continue to debate these questions. 


But as Judith in Monty Python’s Life of Brian exclaims, “Something’s actually happening, Reg!”! 


States across the country are considering and passing school choice programs. Other states are 
expanding existing school choice programs. Families are deciding whether or not to participate in 
them. In light of this, we have endeavored to produce a systematic review of the existing research on 
private school choice to best inform those decisions. 


EdChoice has held a longstanding commitment to synthesizing the empirical research on private 
school choice outcomes. Greg Forster distilled previous summaries of the research that influenced our 
thinking and approach.? In this first installment of The 123s of School Choice, we renew our commitment to 
producing a publication that informs our readers about the summary research findings while also 
providing context about our methods and the varying bodies of research. 


We hope The 123’s of School Choice can be your single, most-trusted resource for understanding the 


rigorous research on private school choice programs in America. If you have any questions or feedback 
about this publication, feel free to email us at: research@edchoice.org. 
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Overall Effects Counts for Studies of Private School 
Choice Programs 
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*One study employed multiple measures of racial integration and concluded that the effects of the program was overall neutral. We included 
this study in the "No Visible Effect" column. 


What Can Research Tell Us About School Choice? 


When it comes to evaluating any public policy, social science is an important, but limited, tool in our 
toolbox. 


The findings of studies, articles and reports have to be examined not only for their validity but also 
must be put in the context of values and priorities that exist outside of the realm of the measurable and 
quantifiable. Studies are limited by their sample, their methods, the data available to researchers and 
the quality of the outcome measures used to determine impact. If the sample is too limited, the data 
too messy or the outcome measure uncorrelated with what we really care about, a study’s large effect 
size might not actually be all that meaningful. Studies like this get published all of the time. Careful 
readers will dig into them before drawing broad sweeping conclusions. 


But even the best-designed studies are limited to things that we can measure and count. It is quite 
challenging to put a number on liberty, autonomy, dignity, respect, racism or a host of constructs that 
we all know exist and are meaningful. Even if an intervention has a positive effect on some measurable 
outcome, it might violate a principle that supersedes it. 


Social science should be used as a torch, not a cudgel. It should help us understand how programs work 
and how they can work better. As an organization that produces research related to private school 
choice and regularly uses it, we think it is important to summarize the extant literature on a topic and 
speak frankly about both its strengths and limitations. 


So, before we dive into the literature on private school choice, there are several important contextual 


issues that we need to discuss. We also want to take a moment and explain some of the decisions that 
we made to include some studies in our review and not others. 
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Heterogeneity of Treatment 


Gertrude Stein wrote “a rose is a rose is a rose,” but is it also true that “a voucher is a voucher is a 
voucher?”? Not necessarily. No two private school choice programs are alike. They differ across an 
array of design features, from how they are funded to rules on accountability to eligibility criteria. The 
Cleveland Scholarship Program, for example is worth $4,650 for elementary students and $6,000 for 
high school students (in 2018-19), while the D.C. Opportunity Scholarship is $8,857 for elementary 
school students and $13,287 for high school students Gin 2018-19). In the Louisiana Scholarship 
Program, participating schools have to take the Louisiana state standardized test, in the Florida Tax 
Credit Scholarship Program, students must simply take one of several approved nationally normed 
standardized tests. Some programs allow schools to apply admissions requirements to students, 
others do not. Some allow families to “top up” their scholarship, adding their own money to help pay 
for schools changing tuiton higher than the voucher amount, others require participating schools to 
accept the voucher for the full cost of the child’s education. Some programs require students to apply to 
aschool first, and then apply for the voucher while others have students apply for the voucher first and 
then apply to the school. Some programs are statewide while others are limited to certain geographic 
areas. Some are limited to low-income students, others are limited to students with special needs. The 
list goes on. 


Any reasonable observer would expect these program differences to affect their impact on the students 
and schools that participate. When we see different outcomes from different studies, how much is that 
due to the peculiarities of those particular programs? What peculiarities drive those findings? We 
don’t yet know. 


We combine these findings and advise some caution about over-interpretation. The findings of one 
study limited to one region or of a program that is structured in a particular way might not apply to 
another potential program in a different place that is structured in a different way. This is why in our 
summaries, we are clear about the geographic location of the studies that we describe, so that readers 
can understand the context around the findings. 


Measures Matter 


It is always important to understand what researchers are measuring. Testing is widely implemented 
across all sectors of schooling, and thus it is unsurprising that a healthy segment of the school choice 
literature studies programs’ effects on student test scores. But it is important to note that testing is 
used differently in different education sectors. For most public and charter schools, test scores are 
part of state accountability systems. They can be rewarded or penalized based on how well students 
perform. Most private schools do not participate in these systems. If you use a measure that one sector 
is pushed to maximize by the state and another is not, you might confuse the effect of that pushing with 
the effectiveness of the school. 
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It is also important to note that many private schools specifically eschew state standards and state 
standardized tests. They argue that those tests do not measure what matters and thus teach their 
own curriculum aligned to what they feel is most important. If we use the results on the state test to 
compare these schools, we might yet again confuse the results. The scores of schools that are aligned 
to the state curriculum might do better, not because they are “better” schools, but simply because they 
are teaching more explicitly what the state test is measuring. 


It is also important to know why parents make choices. If they don’t value test scores, and thus don’t 
choose schools in an effort to maximize them, we shouldn’t be surprised if test scores are lower in the 
schools that they choose. Think of it this way. Some folks like big pickup trucks because they want to 
haul stuff in the bed or tow their boat to the lake on the weekend. They choose based on cargo space 
and towing capacity. If we measure cars based on fuel efficiency, arguing that better cars are more fuel 
efficient, it will look like truck owners are making “bad” choices. They aren’t. They are simply choosing 
ona different dimension. 


Finally, it is important to note two papers that documented evidence suggesting a disconnect between 
test scores and long-run outcomes suchas educational attainmentin school choice program evaluation.* 
There are plausible explanations for this disconnect. For instance, differences in test scores among 
students in public and private schools may simply reflect differences in curricula rather than quality. 
Long-run outcomes of educational attainment, on the other hand, may yield better proxies for how 
a private school choice program affected a student’s employment prospects and future earnings. So 
far there has not been any study to date examining the effect of any private school choice program on 


outcomes related to earned income or employment. 


Why Randomized Control Trials? 


One key decision that we make in compiling the studies that are in the participant effects section was to 
limit the sample to randomized control trials (RCTs). There have been lots of studies of private school 
choice programs (several of which we reference later) that are not RCTs, and so for this guide we are 
clear about when we include or exclude non-RCT studies. Most research literatures either have very 
few RCT studies so far or are simply not conducive to that type of research design. 


When evaluating the effect of a private school choice program, we have to ask the key question: 
“Compared to what?” 


A decrease in average graduation rates among students participating in a choice program doesn’t tell us 
much about the effectiveness of the program. Comparing the change in program participants’ graduation 
rates with students in public schools is somewhat better, but even this comparison provides limited (and 
possibly misleading) information about the program’s effectiveness. There may be factors not being 
accounted for or observed that explain any difference in those outcomes. This fear is particularly acute 
in school choice research, as seeking out a school choice program evinces a level of motivation that is 
potentially not present in families that do not apply to such programs. In fact, trying to cope with selection 
bias is a central methodological issue in estimating the effects of school choice programs. 
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Ideally, to evaluate the effectiveness of a school choice program, we would compare the change in 
outcomes between students who use ascholarship with the change in outcomes of an identical group of 
students (“twins”) who do not participate in the program. Creating a comparison group that provides 
an “apples-to-apples” comparison is challenging. 


The best methodology available to researchers for generating “apples-to-apples” comparisons is an 
RCT, which researchers also refer to as random assignment studies. These studies are also known 
as experimental studies and widely considered to be the “gold standard” of research methodology. 
In fact, the What Works Clearinghouse in the U.S. Department of Education designates RCTs as the 
only research method that can receive the highest rating, “Meets Group Design Standards Without 


25 


Reservations”. 


In RCTs, some random process (like arandom drawing) is used to assign students to the treatment and 
control groups. This method is often referred to as the “gold standard” of research methods because the 
treatment and comparison groups are, on average, identical except for one aspect: one group receives 
the intervention while the other does not. We can attribute any observed differences in outcomes to 
the treatment (a causal relationship). 


Researchers that conduct RCT studies may report unbiased estimates of effects based on two different 
comparisons: 


(1) Researchers may report estimates for “intent-to-treat” (ITT) effects, which compares outcomes 
between students who won the lottery and students who did not win the lottery. ITT is the 
estimated effect of winning the lottery. 


(2) Researchers may also report “treatment-on-the-treated” (TOT) effects, which compare 
differences in outcomes between students who attended a private school and students who did 
not attend private school, regardless of their lottery outcome. TOT is the estimated effect of using 
the voucher. 


When random assignment is not possible, some researchers use statistical techniques to approximate 
randomization. These studies are sometimes referred to as nonexperimental studies. All research 
methods, including RCT, have tradeoffs. While RCTs have very high internal validity because of their 
ability to control for unobservable factors (e.g., student and parent motivation), they do not necessarily 
provide very high (or low) external validity. 


Internal validity is the degree to which the effects we observe can be attributed to the program and 
not other factors. 


External validity is the extent to which results can be generalized to other students in other programs. 
In addition to having a high degree of internal validity, another reason we favor RCTs over other methods 
is that, in the context of evaluating private school choice programs, almost all RCTs occur at the level 


of the program itself. This is in contrast with RCTs in other education policy areas, such as charter 
schools. In charter school RCTs, lotteries occur at the school level, meaning that only schools that held 
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lotteries are included in the study. Given that high-quality schools are likely to be in high demand and 
oversubscribed, results from these studies are likely to be representative of oversubscribed schools, 
but not necessarily representative of schools that are in low demand. Results from RCT studies of 
programs where the lottery is held at the program level give us an estimate of the effect of the program 
rather than just oversubscribed schools. 


As you may have seen if you've already flipped through this guide, we report results for studies based on 
both random assignment (whenever possible) and nonexperimental methods that have some strategy 
for trying to control for self-selection until 10 random assignment studies based on unique student 
populations become available. 


Search Process 


EdChoice regularly monitors research on private school choice. To be as comprehensive as possible, we 
enlisted Hanover Research to conduct a systematic search from 2016 through 2017, since EdChoice’s 
last research review publication. Hanover searched several databases including EconLit, EBSCO, 
PsychINFO, ProQuest, and Google Scholar. They also searched individual publications and working 
paper series such as Education Next, National Bureau of Economic Research, and Journal of School 
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Choice. Fourteen different search terms were used, including “school choice,” “school voucher,” “tax 
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credit scholarships,” “tuition tax credits,” “education savings accounts,” and “ESA.” Since Hanover 


completed this search, we conducted searches on a quarterly basis using EBSCO and Google Scholar. 


How Do We Define a Study? 


We define a “study” as a unique set of one or more data analyses, published together, of at least one 
private school choice program. “Unique” means using data and analytic specifications not identical 
to those in previously reported studies. “Published” means reported to the public in any type of 
publication, paper, article or report. By this definition, all data analyses on a single private school 
choice program outcome that are reported in a single publication are taken together as one “study.” 
Analyses studying multiple programs or multiple program outcomes are identified as different studies 
even if they are contained in a single publication. 


Multiple Studies of the Same Programs 


We include multiple studies of the same program in our review as unique observations. We include them 
because replication is an integral part of the scientific process for discovering truth. It is important to 
consider research by different researchers who study the same programs and different students. It is 
also important to consider reports that employ different rigorous methods. If these efforts arrive at 
similar conclusions, then we can have more confidence about the effects of a program we observe. 
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Wealsotookcare toavoidunnecessary double counting, as this couldlead toasingle program excessively 
influencing the results. In cases where a team of researchers conduct multiple studies to evaluate 
a given program over, we include the most recent analysis from the evaluation. We exclude studies 
that were conducted by the same researchers or research team using the same data. For example, if a 
research team is conducting a longitudinal evaluation and an additional year of data become available 
to update an analysis, we include the most recent analysis and exclude the older analyses. 


If an article or paper includes multiple distinct analyses of different private school choice programs, 
then we counted each of the analyses as distinct studies. We include replication studies by different 
research teams and studies that use different research methods. 


Why No Effect Sizes? 


This guide is a summary of the relevant research on private school choice programs. It is not a meta- 
analysis of those research areas. Meta-analyses attempt to look at the estimates of program effects 
from individual studies and combine them to determine an overall average effect across all of the 
studies. These are difficult and complicated studies to do well. They involve norming the effect sizes to 
numbers that can be combined with one another and averaged. 


That kind of methodology is beyond the scope of our project here. Our goal is to summarize the 
literature. To do so, we have sacrificed a measure of specificity. We believe that tradeoffis worth making. 
But we do want to emphasize that several systemetic reviews or meta-analysis have been conducted on 


certain outcomes and, where appropriate, we cite in the relevant section. 


Now that we have laid out our considerations, we share our summary findings in the rest of this 
publication. We have undertaken this exercise to help inform the debate, not to circumvent it. These 
findings, as with all findings of social science research, must be taken in their proper context and with 
the appropriate qualifications and caveats. We hope to set that example at EdChoice in the ways that 
we use the findings of the studies that follow, and fully expect to hear from our readers when we do not. 
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RESEARCH 
OVERVIEWS FOR 
SEVEN SCHOOL 


CHOICE OUTCOMES 


Do students get better test scores after getting private school vouchers? Studies reviewed in this 
section reveal whether students who won a lottery and/or used scholarships to attend a private school 
of their choice achieved higher test scores than students who applied for but did not receive or use 
scholarships. 


Researchers have studied the effects that programs have on participating students’ test scores. About 
one-third of these studies comprise analyses on a privately funded voucher program in New York 
City. The Louisiana Scholarship Program (LSP) has been the only statewide voucher program studied 
experimentally. All other experimental studies have been of voucher or scholarship programs limited 
to cities, including Milwaukee, Charlotte, Cleveland, Dayton, New York City and Toledo. 


Summary of Studies 


Program Participant Test Scores 


These studies examined three voucher programs and five privately funded scholarship programs 
across five states and D.C. Of the 16 random-assignment studies examining participant test 
scores, 11 have found positive outcomes for either the full sample or at least one subsample 
of students studied. Three found no visible effect for any group of students, and three found 
negative outcomes for all or some group of students. 


About the Methods 


A “study” is defined as an analysis of a private school choice program in the United States, either 
publicly funded or privately funded. Random assignment (also called RTC) is the most rigorous type of 
analysis in social science. For this reason, we focus only on random assignment studies when possible. 


Our inclusion criteria require at least 10 random assignment studies of a certain outcome to exist 
in order for us to exclude all other nonexperimental study types. In the case of studies on program 
participant test scores, we include only random assignment studies. 


Random assignment provides comparison groups that are, on average, equivalent on factors that 
are both observable (e.g., baseline test scores and gender) and unobservable (e.g., student’s and 
parent’s motivation). The only difference between the two groups is exposure to the treatment. Thus, 
differences in measured outcomes between lottery winners and lottery losers can be attributed to the 
private school choice programs rather than students’ background characteristics. 


We consider multiple studies on one program as unique if they study a different group of students 
or use different statistical models or research methods. Several longitudinal evaluations have been 
conducted on private school choice programs, with results reported annually. In these cases, we 
include the most recent evaluation. We exclude studies that were conducted by the same researchers 
or research team using the same data. 
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Test Score Outcomes of Participants from 
Experimental Studies 


Al Some 
students students 
(full sample) (subsample) 


Abdulkadiroglu, Pathak, and Walters Louisiana Louisiana Scholarship Program 


Dynarski et al. Washington, D.C. Opportunity Scholarship Program X 
Mills and Wolf Louisiana Louisiana Scholarship Program X 
Wolf et al. Washington, D.C. Opportunity Scholarship Program 

Greene, Peterson, and Du Milwaukee, WI Milwaukee Parental Choice Program 


Rouse Milwaukee, WI 
Bitler et al. New York, NY 
Jin, Barnard, and Rubin New York, NY 
Cowen Charlotte, NC 
Bettinger and Slonim Toledo, OH 

Krueger and Zhu New York, NY 


Milwaukee Parental Choice Program 


Barnard et al. New York, NY 
Howell et al. Washington, D.C. 
Howell et al. New York, NY 
Howell et al. Dayton, OH 


Greene Charlotte, NC 
V=Voucher J} P = Private Scholarship 


Number of Studies on Program Participant Test Scores 
by Location Additional Research Context 


Researchers from the University of Arkansas conducted a meta-analysis of the test score effects of 
private school choice programs. Dany Shakeel, Kaitlin Anderson and Patrick Wolf analyzed studies on 
school voucher programs globally and estimated the overall effects of these programs on participants’ 


Pp) reading, English and math test scores.° They found that students who simply won the voucher lottery 
(even if they didn’t use the voucher) saw small positive but statistically insignificant gains on test 

scores. On the other hand, students who won the voucher lottery and used the voucher saw larger 

D.C. positive gains on test scores that equate roughly to 50 more days of learning in math and 30 more days 


of learning in reading and English.’ 


Results from the analysis also suggest that reading and math scores increase the longer astudent uses a 


voucher. Impact estimates in reading and English for students participating in U.S. voucher programs 
» indicate a small, negative and statistically insignificant average treatment effect in students’ first year 


in a program. In year four, this effect is positive and statistically significant. The pattern is similar for 
math, except that year four estimates are positive but remain statistically insignificant. 


It is worth noting that recent nonexperimental studies on voucher programs in Indiana and Ohio 
received considerable media attention in the last few years. These analyses used matching methods 
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to study the effects of the program on math and reading or English/Language Arts test scores. Both 
studies found negative math and reading or English/Language Arts test score effects.’ A research 
team from the School Choice Demonstration Project out of the University of Arkansas conducted a 
longitudinal evaluation of Milwaukee’s voucher program that also used matching methods to study 
test score effects and found null effects for math and positive effects on reading.’ 


Although matching may be the best research method available for studying other programs that are 
not or cannot be oversubscribed, they are not as effective as randomized experiments in controlling 
for self-selection bias. Given the large number of random assignment studies of the effects of private 
school choice programs on participant test scores, we are more selective with our methods so that we 
focus attention on the more rigorously designed studies. 


Citations of Studies in Summary Table 
Listed in chronological order, starting with most recent 
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Effect” of Vouchers in Charlotte, Policy Studies Journal, 36(2), pp. 301-315, https://dx.doi.org/10.1111/ 
j.1541-0072.2008.00268.x 


EDCHOICE.ORG 


Eric Bettinger and Robert Slonim (2006), Using Experimental Economics to Measure the Effects of a 
Natural Educational Experiment on Altruism, Journal of Public Economics, 90(8-9), pp. 1625-1648, 
https://dx.doi.org/ 10.1016/j.jpubeco.2005.10.006 


Alan Krueger and Pei Zhu (2004), Another Look at the New York City School Voucher Experiment, 
American Behavioral Scientist, 47(5), pp. 658-698, https://dx.doi.org/10.1177/0002764203260152 


John Barnard, Constantine Frangakis, Jennifer Hill, and Donald Rubin (2008), Principal Stratification 
Approach to Broken Randomized Experiments: A Case Study of School Choice Vouchers in New 
York City, Journal of the American Statistical Association, 98(462), pp. 310-326, https://dx.doi. 
org/10.1198/016214503000071 


William G. Howell, Patrick J. Wolf, David E. Campbell, and Paul E. Peterson (2002), School Vouchers 
and Academic Performance: Results from Three Randomized Field Trials, Journal of Policy Analysis 
and Management, 21(2), pp. 191-217, https://dx.doi.org/10.1002/pam.10023 


Jay P. Greene (2001), Vouchers in Charlotte, Education Matters, 1(2), pp. 55-60, retrieved from 
Education Next website: http://educationnext.org/files/ednext20012_46b.pdf 


Jay P. Greene, Paul Peterson, and Jiangtao Du (1999), Effectiveness of School Choice: The Milwaukee 
Experiment, Education and Urban Society, 31(2), pp. 190-213, https://dx.doi.org/10.1177/00131245990 
31002005 


Cecilia E. Rouse (1998), Private School Vouchers and Student Achievement: An Evaluation of the 


Milwaukee Parental Choice Program, Quarterly Journal of Economics, 113(2), pp. 553-602, https:// 
dx.doi.org/10.1162/003355398555685 


THE 123s OF SCHOOL CHOICE 


This section reviews studies that examined whether students who won a lottery or used scholarships 
to attend a private school of their choice were more likely to graduate from high school, more likely to 
enroll in college and/or more likely to persist in college than students who did not use scholarships. 


Parents, policymakers, and other stakeholders ultimately care about the long-run effects of education 
programs. Some research suggests a relationship between better educational attainment and later life 
outcomes, such as employment outlook, earnings, health, longevity and likelihood to commit crime. From 
the early years of choice programs, some people have usually relied on test scores to help determine the 
effectiveness of choice programs on grounds that they provide reliable proxies for outcomes later in life. 


Summary of Studies 


Total Number 
of Studies 


a a a a 


These studies examined three voucher programs, one tax-credit scholarship program and one 
privately funded scholarship program across four states and D.C. Of the six studies examining 
program participants’ educational attainment, four have found positive outcomes for either the 
full sample or at least one subsample of students studied and two studies found no visible 
effect for any group of students. None of these studies found negative educational attainment 
outcomes for all or some students. 


Program Participant Attainment 


About the Methods 


Studies considered in this section employ random assignment and matching methods. In the context 
of school choice research, random assignment occurs via lotteries conducted for oversubscribed 
programs where lottery winners are awarded scholarships to attend a private school, and lottery losers 
do not receive vouchers. Studies that use matching methods compare students participating in a choice 
program with a group of students enrolled in public schools that have the same or similar observed 
characteristics, such as baseline test scores, free and reduced-price lunch status, race/ethnicity or 
parent characteristics. 


Given that only three studies on educational attainment utilize random assignment, we also include 
studies that use nonexperimental methods that use some strategy for controlling for self-selection. 
We exclude observational methods with only control variables as they do not control for self-selection. 


Additional Research Context 


Lisa Foreman reviewed the academic literature on educational attainment effects on students 
participating in private school voucher programs and charter schools.'° She found generally positive 
findings in the studies she reviewed. We do not include one study that was included in Foreman’s 
review because it is an observational study and does not use methods to account for self-selection.” 
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Attainment Outcomes of Participants from All 
Empirical Studies 
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Citations of Studies in Summary Table 
Listed in chronological order, starting with most recent 
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This section considers the effect of private school choice programs on parents’ satisfaction with 
their chosen schools. We examine this body of research because parents are in the best position to 
understand what educational environment best fits their children. There does not exist a single way or 
type of school that can serve all children well. Considering parent satisfaction can help policy makers 
gauge the efficacy of choice policies. 


Most studies focus on overall school satisfaction, while some narrow in on satisfaction with specific 
aspects of the chosen school. When possible, study authors draw direct comparisons to families’ former 
public schools. Studies that ask parents of all schooling options allow for comparisons of satisfaction 
across schooling sectors. 


The body of parent satisfaction studies has examined private school choice programs in Arizona, 
California, Florida, Georgia, Indiana, Mississippi, North Carolina, New Hampshire, New York, Ohio, 
Texas, Wisconsin and D.C., plus national programs. Private school choice programs in Wisconsin have 
been the most studied in terms of numbers of parent satisfaction studies. 


Overall, parents with children participating in programs are more satisfied with their chosen private 
school than their previous school and are more satisfied with their schools than other private school 
parents and public school parents. 


Summary of Studies 


Total Number 
of Studies 


Parent Satisfaction [26 -].- 26] os 


These studies examined two ESA programs, seven voucher programs, three tax-credit scholarship 
programs, and at least seven privately funded scholarship programs across 12 states and D.C. Of 
the 26 studies examining the effects of private school choice programs on parent satisfaction, 
26 have found positive effects, zero studies found no visible effect and zero studies found 
negative effects. 


About the Methods 


Studies in this section make use of surveys of parents of participating students to gauge satisfaction 
with their chosen private school compared to their previous school or compared to non-participant 
satisfaction levels. 


Some of the programs studied have designs that allow for a random assignment study, while most are 
observational—meaning differences are compared within or across groups that were not randomly 
assigned. Our inclusion criteria require at least 10 studies based on random assignment in order to 
exclude all nonexperimental studies. Given that eight studies on parent satisfaction use random 
assignment, we include studies that use nonexperimental methods. 
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Parent Satisfaction Impacts from Private Educational 
Choice Programs 
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Special Needs Scholarship Program Wisconsin 
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Opportunity Scholarships North Carolina 
Opportunity Scholarship Program Washington, D.C. 
Milwaukee Parental Choice Program Milwaukee, WI 
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Cleveland Scholarship Program 
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Choice Scholarship Program/School Scholarship Tax Credit Indiana V/TCS 2016 
Choice Scholarship Program/School Scholarship Tax Credit Indiana V/TCS 2015 


School Scholarship Tax Credit Indiana TCS 2017 

Education Tax Credit Program New Hampshire TCS 2017 

Qualified Education Expense Tax Credit Georgia TCS 
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New York, NY 
National 


Washington, D.C. 
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San Francisco, CA 
San Antonio, TX 
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ESA = Educational Savings Account | V = Voucher | TCS = Tax-Credit Scholarship || P = Private Scholarship 


*The report combined voucher and tax-credit scholarship parents into "Choice Parents," although anyone could calculate voucher 
and tax-credit scholarship results based on data tables in the report appendices. 
+The report combined voucher and tax-credit scholarship parents into "Choice Parents" for all information made publicly available. 


Note: This table shows all studies using all methods. 
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Number of Studies on Parent Satisfaction by Location 
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Additional Research Context 


Evan Rhinesmith conducted a systematic review to synthesize the parent satisfaction literature for 
private school choice programs. The systematic review reports that participating in private school 
choice programs leads to higher levels of parent satisfaction. Rhinesmith states, “If methodology is 
behind the results, we would expect the experimental and observational studies to differ dramatically 
in their results. They do not. Whether students enrolled in their choice program through lottery or self- 
sorted into their private school of choice, the results have shown that providing choice in education 
leads to higher levels of parent satisfaction.”” 
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Listed in chronological order, starting with most recent 
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These studies examine the competitive effects of private school choice programs on public school 
students. They study whether a private school choice program has an effect on the test scores of 
students who remain in public schools. 


A concern often expressed when people hear about school vouchers is that these programs leave 
students who remain in public schools worse off. School choice programs might divert resources or 
the most capable students away from public schools, harming the children who are “left behind.” Have 
these fears come to pass? This section strives to answer that question. 


Overall, fears of harm to public school students are overblown. In fact, there is compelling evidence 


that public school students experience modest test score gains after private school choice programs 
are introduced or expanded. 


Summary of Studies 


Public School Students’ Test Scores 


; These studies examined nine voucher programs, one tax-credit scholarship program and one 

privately funded scholarship program across eight states and D.C. Of the 26 studies examining 

. ial the effects of private school choice programs on public school test scores, 24 have found 
z= positive effects, one study found no visible effect and one study found negative effects. 


About the Methods 


We include studies that use nonexperimental methods given that no studies on competitive effects use 
random assignment. 


An important concern with non-experimental methods is that public schools that face greater 
competitive pressure—more expansive private school choice programs—may be systematically 
different than public schools facing lesser competitive pressures—more limited private school choice 
programs. Researchers in these studies attempt to use statistical techniques to address these concerns. 


There are several ways that researchers estimate the effects of private school choice programs on 
public school students’ test scores. 


For example, they may measure competition by estimating the percentage of students in a district 
or public school who are eligible for a choice program, with the idea being that public schools with a 
greater portion of students eligible for a program face greater competition because they stand to lose 
more students than if a smaller proportion of their students were eligible. They may also use distance 
measures in their models by measuring the proximity between a public school and the nearest private 
school. Some studies also employ density measures, which count the number of private schools within 
a given radius or distance from the public school. 
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Public School Students’ Test Scores from 
Empirical Studies 


Egalite Louisiana Scholarship Program Louisiana V 

Figlio and Karbownik Educational Choice Scholarship Program Ohio V 

Bowen and Trivitt Opportunity Scholarship Program* Florida V Po xX 
Jacob and Dougherty Choice Scholarship Program Indiana V 

Chakrabarti Opportunity Scholarship Program* Florida V 

Carr Educational Choice Scholarship Program Ohio V 

Winters and Greene John M. McKay Scholarships for Students with Disabilities Program Florida V 

Mader Milwaukee Parental Choice Program Milwaukee, WI V 

Greene and Marsh Milwaukee Parental Choice Program Milwaukee, WI V 

Chakrabarti Milwaukee Parental Choice Program Milwaukee, WI V 

Forster Educational Choice Scholarship Program Ohio V 

Forster Opportunity Scholarship Program* Florida V 

Carnoy et al. Milwaukee Parental Choice Program Milwaukee, WI V 

Greene and Winters Opportunity Scholarship Program Washington, D.C. V 

Figlio and Rouse Opportunity Scholarship Program* Florida V 

West and Peterson Opportunity Scholarship Program* Florida V 

Greene and Winters Opportunity Scholarship Program* Florida V 

Greene and Forster Milwaukee Parental Choice Program Milwaukee, WI V 

Hammons Town Tuitioning Program Maine V 

Hammons Town Tuitioning Program Vermont V 

Hoxby Milwaukee Parental Choice Program Milwaukee, WI V 

Greene Opportunity Scholarship Program* Florida V 2001 
Figlio and Hart Florida Tax Credit Scholarship Program Florida TCS 
Rouse et al. Florida Tax Credit Scholarship Program Florida eS 2013 | 


Gray, Merrifield, and Adzima San Antonio, TX 2016 
Greene and Forster San Antonio, TX 2002 
V=Voucher [| TCS = Tax-Credit Scholarship [| P = Private Scholarship 


*The Florida Supreme Court declared that the private school voucher component of the program was unconstitutional in January 2006. 
Note: This table shows all empirical studies using all methods. 
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Additional Research Context 


Several systematic reviews have been conducted to synthesize the competitive effects literature for 
private school choice programs. All of these systematic reviews acknowledge that private school choice 
programs tend to induce public schools to improve. The body of evidence suggests that improvement 
increases with the intensity of competition. 


Dennis Epple and colleagues state that “evidence on both small-scale and large-scale programs 
suggests that competition induced by vouchers leads public schools to improve.”* 


Patrick Wolf and Anna Egalite examine research on competition in the K-12 system and note that 
the literature “suggest that growing educational competition from charter schools, vouchers, and 
tax-credit scholarship programs holds the promise of improving the productivity of district schools, 
subject to the effective design of school choice policies.”* They also note, ina separate study, “Students 
who remain in public schools that faced competition from choice programs tend to score higher on 
standardized tests, especially if the threat of competition is large.”* 


Egalite found “neutral to positive results” in her own review of the competitive effects literature.’ She 
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also notes that results from studies able to use a quasi-experimental method (regression discontinuity) 
“unanimously find positive impacts on student academic achievement.” Furthermore, she states, 
“Such overwhelming evidence supports the development of market-based schooling policies as a 
means to increase student achievement in traditional public schools.”* 
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CIVI 


VALUES AND 
PRACTICES 


Instilling common democratic and civic values is a core purpose and argument for the public funding of 
K-12 education. The United States is also becoming increasingly diverse with each oncoming generation of 
Americans. Historically, elementary and secondary schools have had an important role leveling the playing 
field for students when it comes to socialization around shared civic values and activities. 


The research on private school choice programs point to a track record indicating that these programs 
can, in fact, help establish and strengthen civicnorms and practices. They are foundational to sustaining 
good citizenship, civil society and representative democracy in our country. 


Studies examined in this section analyze whether enrolling in a private school choice program has 
an effect on students’ civic values or how students exhibit civic practices. Such values and practices 
include: tolerance for the rights of others, civic knowledge, civic participation, volunteerism, social 
capital, civic skills, voter registration, voter turnout and patriotism. Studies that assess criminal 
activity tendencies are also considered for this section. 


Summary of Studies 


These studies examined two voucher programs and at least three privately funded scholarship 
programs across five states. Of the 11 studies examining the effects of private school choice 
programs on public school test scores, six have found positive effects, five studies have found 
no visible effect, and zero studies found negative effects. 


About the Methods 


To examine how private schools in choice programs differ from public schools, if at all, in promoting 
civic values in their students, researchers rely primarily on survey methods. They compare measured 
outcomes between students participating in private school choice programs and similar students 
in public schools. Some studies of programs compared students who applied to programs and were 
randomly assigned via lottery to treatment and control groups. 


Studies researching tolerance observe the effect of students’ tolerance for others before and after 
using school choice, largely via survey questionnaires that gauge whether students recognize the 
views and rights of groups for which they disagree. Tolerance is defined as a willingness to extend legal 
protections to groups with whom one has disagreements. Civic engagement includes measures such as 
political participation, voting, giving to charity and volunteering. 


For the purposes of reporting civic outcomes, we consider only the voucher and private scholarship 
participants’ effects. This review includes random assignment and nonexperimental studies. 
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Civic Values and Practices from All Empirical Studies 


DeAngelis and Wolf Milwaukee Parental Choice Program 
DeAngelis and Wolf Milwaukee Parental Choice Program 
Mills et al. Louisiana Scholarship Program 
Fleming, Mitchell, and McNally Milwaukee Parental Choice Program 
Fleming Milwaukee Parental Choice Program 
Carlson, Chingos, and Campbell 

Campbell 


Bettinger and Slonim 
Howell and Peterson 
Peterson and Campbell 
Wolf, Peterson, and West 
V=Voucher J} P = Private Scholarship 


Note: This table shows all empirical studies using all methods. 


Number of Studies on Civic Values and 
Practices by Location 
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Though we might want to separate social order and criminal activity studies into their own section 
in the future, only one such study exists to date, so this research area has been consolidated into this 
section. This study matched students who participated in Milwaukee’s voucher program with students 
in the Milwaukee Public School district and examined whether students who used vouchers were more 
likely to engage in criminal activity compared to their matched peers. 


Additional Research Context 


Corey DeAngelis published a systematic review of the civic effects of school choice programs in 2017. 
While others have compiled civic outcomes research of other types of schooling, including charter 
schools, DeAngelis’s review is the only one that exclusively examines private school choice. He found 
generally null to positive results of private school choice programs on students’ tolerance, null to 
positive results for civic engagement and positive results for social order. For social order, the author 
reviewed studies that examine the levels of criminal activity of school choice participants.” 
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Citations of Studies in Summary Table 
Listed in chronological order, starting with most recent 
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Measuring school choice’s impact on integration is both challenging and very important. Research in 
this area is essential because of the longstanding history and concern about segregation in America’s 
public and private schools. 


It is important to keep in mind that the public education system in the US. has led to significantly 
greater sorting across schools by family income level, documented by Ann Owens, Sean Reardon and 
Christopher Jencks.” Further, Benjamin Scafidi showed how racial sorting in public schools has 
increased or lagged improvements in neighborhood integration over the past few decades.”! Given 
the strong link between neighborhoods and residential assignment, the pattern that neighborhoods 
have become more integrated while public schools have become more segregated is puzzling. Better 
understanding if increasing educational choice facilitates integration in schools or weakens it is a 
worthy endeavor. 


There has been substantial difficulty determining what it means for a school to become more or less 
integrated because it is not clear to what standard it should be held. Is a school integrated when it 
matches the demographic characteristics of its neighborhood? The city in which it sits? The county? 
The state? This matters because, as Gary Ritter, Nathan Jensen, Brian Kisida and Joshua McGee 
showed, picking different comparison groups can yield completely different findings. 7? 


But it doesn’t stop there. When a student moves from one school to another, he or she affects the racial 
composition of both the school he or she left and the school he or she joined. From whose perspective 
should we view this? Is it positive when a student has the opportunity to attend a more integrated 
school? What about the experience of the children left behind? Similarly, if the student goes to a more 
segregated school, that movement could make their old school more integrated. What is a “positive” 
finding in this scenario? 


If that is not enough, researchers can usually look only at school-level segregation. But what happens 
once a student walks through the school doors? Are classrooms integrated, or are children of different 
races tracked into different courses? Is the lunchroom? Are extra-curricular activities? Conceivably a 
putatively “integrated” school could still be segregated in practice. Data alone simply can’t sufficiently 
answer these research questions. 


In this section, we consider studies that examine the effect of school choice programs on racial and 
ethnic diversity in public and private schools. Since the late 1990s researchers have analyzed the 
impacts of school voucher programs in this area. 


Because researchers’ methods vary, we advise some caution to readers of this section and encourage 
further exploration of the individual studies. We have endeavored to be as transparent as possible as to 
how the researchers chose to cope with the above questions. That said, the body of the research to date 
indicates that existing choice programs are promoting integration. 
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Summary of Studies 


Racial/Ethnic Integration 


These studies examined four voucher programs across three states and D.C. Of the seven studies 
examining school choice’s effect on integration in schools, six found positive effects. One was 
unable to detect any effects, and none found negative effects. 


About the Methods 


This section considers studies that employ a variety of methods. Most studies employ methods yielding 
results that are descriptive in nature. These measures of integration compare the following: 


e the racial/ethnic composition of public and private schools and the racial/ethnic composition of 


the choice program’s metropolitan area 


e the racial/ethnic composition of public and private schools before and after the introduction or 


expansion of a choice program 


e the racial/ethnic composition of public and private schools, assuming choice students had enrolled 


in their district schools instead 


e the racial/ethnic composition of classrooms in public and private schools compared with the 


racial composition of the nation’s general population 


e the shares of public and private schools that are racially homogenous (usually defined as a school 
with at least 90 percent of student enrollment that is white or minority) 


Methods that move a step closer to providing causal evidence employ student-level data over time 
and identify the effect that choice program participants had on the racial/ethnic composition of their 
originating and receiving schools after participating in the choice program. The table on page 46 
depicts the four possible outcomes. 


A transfer that results in both schools becoming more integrated is considered positive while a transfer 
that leaves both schools less integrated is considered negative. Two of these effects are mixed (i.e., 
when a student transfers, either the originating or receiving school becomes more integrated while 
the other school becomes less integrated.) 


We include only studies of private school choice programs in the United States, both publicly funded 
and privately funded. Given that no studies on integration effects use random assignment, we include 
studies that use nonexperimental methods. We include empirical studies only and do not include 


simulation studies. 
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Integration Effects, Possible Outcomes After Student 
Transferred Via School Choice Program 


Negative 


Additional Research Context 


Elise Swanson surveyed the literature on the effects of various school choice sectors (magnet, charters, 
and private) on integration in schools. In her review of studies on voucher programs, she reviewed 
eight studies, finding that seven studies found voucher programs improved school integration and 
one study was unable to detect any effects. She notes that “it is perhaps unsurprising that traditional 
public schools exhibit, to this day, high levels of racial segregation, and that choice programs, including 
vouchers, that decouple the link between address and school actually increase racial integration.” 7° 


Number of Studies on Racial Integration by Location 
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Racial Integration from All Empirical Studies 


Egalite, Mills, and Wolf Louisiana Scholarship Program 
Greene, Mills, and Buck Milwaukee Parental Choice Program 
Greene and Winters Opportunity Scholarship Program 


Forster Milwaukee Parental Choice Program 


Forster Cleveland Scholarship Program 
Fuller and Mitchell Milwaukee Parental Choice Program 
Greene Cleveland Scholarship Program 


V = Voucher 


Notes: This table shows all empirical studies using all methods; the total effect on segregation in all schools is referenced. Table excludes 


studies that do not adequately define segregation or fail to make appropriate comparisons. For example, comparing the racial makeup of a 
given school to the makeup of a larger administrative unit such as a school district or municipality can be misleading and fails to directly 
measure the effect of introducing a private school choice program. 


Citations of Studies in Summary Table 
Listed in chronological order, starting with most recent 
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These studies examine the fiscal effect of private school choice programs on taxpayers, state budgets 
and public school districts. In terms of the number of analyses conducted on private school choice 
programs, fiscal effects have been studied most. 


One of the most common criticisms levied against school choice is that these programs “drain” 
or “siphon” resources from public schools. A recent national survey by Paul DiPerna and Michael 
Shaw found that 27 percent of respondents opposed to ESAs indicated that diverting funding away 
from public schools is the most important reason for their opposition.** In light of such concerns, 
policymakers often want to better understand the fiscal impacts of these programs. 


Assessing the fiscal impact of a school choice program is complicated because school funding comes 
day t . , from several different sources (federal, state and local governments) and because school funding 
> — ae a ee formulas themselves are exceedingly complex. It is important when there are costs or savings to 
x ; identify to whom they are accruing. 


“eae 


28S There is a second issue at work that deserves deeper scrutiny as well. When it comes to how much 


these programs cost taxpayers and their potential effects on school districts, some tend to focus on 
the price tag of scholarships awarded via private school choice programs. What they tend to ignore, 
however, is that there are cost savings associated with students who leave the public K-12 system. That 
is, when students leave their public school by using vouchers, that public school gets a reduction in 
funding. That school also has a reduction in educational costs, as it has fewer students to educate. 


The body of fiscal analyses on private school choice programs examined in this section generally find 
that private school choice programs generate positive fiscal benefits for taxpayers and school districts. 


Summary of Studies 


Total Number 
of Studies 


Fiscal Effects 


Analyses reviewed here cover 20 voucher programs, 11 tax-credit scholarship programs and 
one privately funded scholarship program across 18 states and D.C. Of 50 studies on the fiscal 
effects of private school choice programs, 45 found that programs generated net savings for 
taxpayers. Four found those programs were cost-neutral, and one study estimated that a program 
generated net costs. 
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Fiscal Effects on Taxpayers and Public Schools 
from All Empirical Studies 


Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 


Trivitt and DeAngelis 


Wisconsin LAB* 


DeAngelis and Trivitt 
Trivitt and DeAngelis 


Spalding 


Wolf and McShane 


Costrell 
Aud 
Aud 
Aud 
Aud 
Aud 
Aud 
Aud 
Aud 
Aud 
Aud and Michos 


V = Voucher 


Opportunity Scholarship Program 

John M. McKay Scholarships for Students with Disabilities Program 
Georgia Special Needs Scholarship Program 

Choice Scholarship Program 

Louisiana Scholarship Program 

School Choice Program for Certain Students with Exceptionalities 
Mississippi Dyslexia Therapy Scholarship for Students with Dyslexia Program 
Cleveland Scholarship Program 

Autism Scholarship Program 

Educational Choice Scholarship Program 

Jon Peterson Special Needs Scholarship Program 

Lindsey Nicole Henry Scholarships for Students with Disabilities 
Carson Smith Special Needs Scholarship Program 

Milwaukee Parental Choice Program 

Parental Private School Choice Program (Racine) 

Succeed Scholarship Program 

Special Needs Scholarship Program 

Louisiana Scholarship Program 

Louisiana Scholarship Program 

Opportunity Scholarship Programt 

Opportunity Scholarship Program 

Milwaukee Parental Choice Program 

Town Tuitioning Program 

Town Tuitioning Program 

John M. McKay Scholarships for Students with Disabilities Program 
Opportunity Scholarship Programt 

Opportunity Scholarship Program 

Cleveland Scholarship Program 

Autism Scholarship Program 

Carson Smith Special Needs Scholarship Program 

Milwaukee Parental Choice Program 

Opportunity Scholarship Program 


*State of Wisconsin Legislative Audit Bureau 
+The Florida Supreme Court declared that the private school voucher component of the program was unconstitutional in January 2006. 
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Fiscal Effects on Taxpayers and Public Schools 
from All Empirical Studies (continued) 


Dearmon and Evans Oklahoma 


Oklahoma Equal Opportunity Education Scholarships 


Lueken Original Individual Income Tax Credit Scholarship Program Arizona 
Lueken Low-Income Corporate Income Tax Credit Scholarship Program Arizona 
Lueken Lexie's Law for Disabled and Displaced Students Tax Credit Scholarship Program Arizona 
Lueken "Switcher" Individual Income Tax Credit Scholarship Program Arizona 
Lueken Florida Tax Credit Scholarship Program Florida 
Lueken Qualified Education Expense Tax Credit Georgia 
Lueken School Scholarship Tax Credit Indiana 
Lueken School Tuition Organization Tax Credit lowa 

Lueken Educational Improvement Tax Credit Program Pennsylvania 
Lueken Tax Credits for Contributions to Scholarship Organizations Rhode Island 
Girardi and Gullickson| School Tuition Organization Tax Credit lowa 
LOEDR# Florida Tax Credit Scholarship Program Florida 
OPPAGAS§ Florida Tax Credit Scholarship Program Florida 

Aud Original Individual Income Tax Credit Scholarship Program Arizona 

Aud Educational Improvement Tax Credit Program Pennsylvania 


Florida ; 


San Antonio, TX | P| 2009 | | 


Aud 
Merrifield & Gray 
TCS = Tax-Credit Scholarship [J P = Private Scholarship 


*State of Wisconsin Legislative Audit Bureau 


Florida Tax Credit Scholarship Program 


+The Florida Supreme Court declared that the private school voucher component of the program was unconstitutional in January 2006. . . 

£LOEDR stands for Legislative Office of Economic and Demographic Research (State of Florida) N U mber of Stud es on Fiscal Effects on Taxpayers and 
§OPPAGA stands for Office of Program Policy Analysis and Government Accountability (State of Florida) 7 : 

Notes: This table shows all empirical studies using all methods; the total fiscal effect of school choice programs is referenced. Table excludes any b S b 

analyses that fail to make a reasonable attempt to account for both sides of the ledger, i.e. both costs and savings from school choice programs. Pu | IC Cc hools y Location 
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About the Methods 


Researchers and fiscal analysts have employed a variety of accounting techniques to estimate the fiscal 
effects of private school choice programs on different groups. Any fiscal analysis should account for 
switchers, or students who would likely enroll in a public school if they did not receive any financial 
assistance from the choice program. It is not accurate to assume that all students using school choice 


programs would attend private schools even without access to the program. 


Because it is impossible to know with complete certainty whether students are switchers, some 
analyses also report “break-even switcher rates” for programs, or the share of program participants 
who must be switchers for a program to be cost-neutral. Break-even switcher rates are intended to give 
policymakers a general sense about a program’s fiscal impact, ie., if it is likely to generate net savings 


or costs. 


We review all fiscal analyses of operational U.S. school choice programs—both publicly funded and 
privately funded—that make a reasonable attempt to account for both costs and savings associated 
with switchers. We exclude any analyses that report estimates only for the cost of scholarship. We do 
not consider fiscal analyses of school choice bills, such as legislative fiscal notes. 
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RESEARCH STUDIES BY 
PROGRAM TYPE 


Research Studies on ESA Programs 


Parent Satisfaction Impacts from Private Educational Choice Programs 


Equal Opportunity for Students with Special Needs Program Mississippi 2016 
Empowerment Scholarship Accounts Arizona 2013 


Kittredge 
Butcher and Bedrick 


Research Studies on Voucher Programs 


Test Score Outcome of Participants from Random Assignment Studies 


Abdulkadiroglu, Pathak, and Walters | Louisiana Scholarship Program Louisiana 
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X 
X 

Mills and Wolf Louisiana Scholarship Program Louisiana X 

Wolf et al. Opportunity Scholarship Program Washington, D.C. 

Greene, Peterson, and Du Milwaukee Parental Choice Program Milwaukee, WI 

Rouse Milwaukee Parental Choice Program Milwaukee, WI 

Attainment Outcomes of Participants from All Empirical Studies 
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Erickson, Mills, and Wolf Louisiana Scholarship Program Louisiana 

Wolf, Witte, and Kisida Milwaukee Parental Choice Program Milwaukee, WI 


Wolf et al. Opportunity Scholarship Program Washington, D.C. 
Parent Satisfaction Impacts from Private Educational Choice Programs 


Greene and Forster 
Witte 
Metcalf 


Peterson, Howell, and Greene 


John M. McKay Scholarships for Students with Disabilities Program 
Milwaukee Parental Choice Program 

Cleveland Scholarship Program 

Milwaukee Parental Choice Program 


Florida 

Milwaukee, WI 
Cleveland, OH 
Milwaukee, WI 


Department of Public Instruction Special Needs Scholarship Program Wisconsin Jv 
Catt and Rhinesmith Choice Scholarship Program Indiana v 
Egalite, Gray, and Stallings Opportunity Scholarships North Carolina JV 
Catt and Rhinesmith* Choice Scholarship Program/School Scholarship Tax Credit Indiana Jv 
Kisida and Wolf Opportunity Scholarship Program Washington, D.C. f 
DiPernat Choice Scholarship Program/School Scholarship Tax Credit Indiana J 
Witte et al. Milwaukee Parental Choice Program Milwaukee, WI ’ 


Greene, Howell, and Peterson Cleveland Scholarship Program Cleveland, OH 


*The report combined voucher and tax-credit scholarship parents into "Choice Parents," although anyone could calculate voucher and tax-credit 
scholarship results based on data tables in the report appendices. 


+The report combined voucher and tax-credit scholarship parents into "Choice Parents" for all information made publicly available. 
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Research Studies on Voucher Programs (continued) 


Parent Satisfaction Impacts from Private Educational Choice Programs (continued) 


Egalite 

Figlio and Karbownik 
Bowen and Trivitt 
Jacob and Dougherty 
Chakrabarti 

Carr 

Winters and Greene 
Mader 

Greene and Marsh 
Chakrabarti 
Chakrabarti 

Forster 

Forster 

Carnoy et al. 

Figlio and Rouse 
Greene and Winters 
West and Peterson 
Chakrabarti 

Greene and Winters 
Greene and Forster 
Hammons 
Hammons 

Hoxby 

Greene 


Louisiana Scholarship Program 
Educational Choice Scholarship Program 
Opportunity Scholarship Programt 
Choice Scholarship Program 

Opportunity Scholarship Programt 
Educational Choice Scholarship Program 
John M. McKay Scholarships for Students with Disabilities Program 
Milwaukee Parental Choice Program 
Milwaukee Parental Choice Program 
Milwaukee Parental Choice Program 
Opportunity Scholarship Programt 
Educational Choice Scholarship Program 
Opportunity Scholarship Programt 
Milwaukee Parental Choice Program 
Opportunity Scholarship Programt 
Opportunity Scholarship Program 
Opportunity Scholarship Programt 
Opportunity Scholarship Programt 
Opportunity Scholarship Programt 
Milwaukee Parental Choice Program 
Town Tuitioning Program 

Town Tuitioning Program 

Milwaukee Parental Choice Program 
Opportunity Scholarship Programt 


+The Florida Supreme Court declared that the private school voucher component of the program was unconstitutional in January 2006. 
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Louisiana 
Ohio 

Florida Po 
Indiana 
Florida 

Ohio 

Florida 
Milwaukee, WI 
Milwaukee, WI 
Milwaukee, WI 
Florida 

Ohio 

Florida 
Milwaukee, WI 
Florida 
Washington, D.C. 
Florida 

Florida 

Florida 
Milwaukee, WI 
Maine 
Vermont 
Milwaukee, WI 
Florida 
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Research Studies on Voucher Programs (continued) 


Civic Values and Practices from All Empirical Studies 


DeAngelis and Wolf Milwaukee Parental Choice Program Milwaukee, WI 

DeAngelis and Wolf Milwaukee Parental Choice Program Milwaukee, WI 

Mills et al. Louisiana Scholarship Program Louisiana 

Fleming, Mitchell, and McNally | Milwaukee Parental Choice Program Milwaukee, WI 

Fleming Milwaukee Parental Choice Program Milwaukee, WI 

Racial Integration from All Empirical Studies 

Egalite, Mills, and Wolf Louisiana Scholarship Program Louisiana 

Greene, Mills, and Buck$ Milwaukee Parental Choice Program Milwaukee, WI 

Greene and Winters Opportunity Scholarship Program Washington, D.C. 

Forster Milwaukee Parental Choice Program Milwaukee, WI 

Forster Cleveland Scholarship Program Cleveland, OH 

Fuller and Mitchell Milwaukee Parental Choice Program Milwaukee, WI 

Greene Cleveland Scholarship Program Cleveland, OH 
Fiscal Effects on Taxpayers and Public Schools from All Empirical Studies 

Lueken Opportunity Scholarship Program Washington, D.C. 

Lueken John M. McKay Scholarships for Students with Disabilities Program Florida 

Lueken Georgia Special Needs Scholarship Program Georgia 

Lueken Choice Scholarship Program Indiana 

Lueken Louisiana Scholarship Program Louisiana 

Lueken School Choice Program for Certain Students with Exceptionalities Louisiana xX 

Lueken Mississippi Dyslexia Therapy Scholarship for Students with Dyslexia Program Mississippi 


Lueken Cleveland Scholarship Program Cleveland, OH 


§This study employed multiple measures of racial integration and concluded that the effects of the program was overall neutral. We included this 
study in the "No Visible Effect" column. 
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Research Studies on Voucher Programs (continued) 


Fiscal Effects on Taxpayers and Public Schools from All Empirical Studies (continued) 


Lueken Autism Scholarship Program 

Lueken Educational Choice Scholarship Program 

Lueken Jon Peterson Special Needs Scholarship Program 
Lueken Lindsey Nicole Henry Scholarships for Students with Disabilities 
Lueken Carson Smith Special Needs Scholarship Program 
Lueken Milwaukee Parental Choice Program 

Lueken Parental Private School Choice Program (Racine) 
Trivitt and DeAngelis Succeed Scholarship Program 

Wisconsin LAB# Special Needs Scholarship Program 

DeAngelis and Trivitt Louisiana Scholarship Program 

Trivitt and DeAngelis Louisiana Scholarship Program 

Spalding Opportunity Scholarship Programt 

Wolf and McShane Opportunity Scholarship Program 

Costrell Milwaukee Parental Choice Program 

Aud Town Tuitioning Program 

Aud Town Tuitioning Program 

Aud John M. McKay Scholarships for Students with Disabilities Program 
Aud Opportunity Scholarship Programt 

Aud Opportunity Scholarship Program 

Aud Cleveland Scholarship Program 

Aud Autism Scholarship Program 

Aud Carson Smith Special Needs Scholarship Program 
Aud Milwaukee Parental Choice Program 

Aud and Michos Opportunity Scholarship Program 


+The Florida Supreme Court declared that the private school voucher component of the program was unconstitutional in January 2006. 
#State of Wisconsin Legislative Audit Bureau 
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Ohio 

Ohio 

Ohio 
Oklahoma 
Utah 
Milwaukee, WI 
Racine, WI 
Arkansas 
Wisconsin 
Louisiana 
Louisiana 
Florida 


Washington, D.C. 


Milwaukee, WI 
Vermont 
Maine 

Florida 

Florida 


Washington, D.C. 


Cleveland, OH 
Ohio 
Utah 
Milwaukee, WI 


Washington, D.C. 
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Research Studies on Tax-Credit Scholarship Programs 


Attainment Outcomes of Participants from All Empirical Studies 


Chingos, Monarrez, and Kuehn 


Florida Tax Credit Scholarship Program Florida 2019 f bot 


Parent Satisfaction Impacts from Private Educational Choice Programs 


Department of Revenue Administration 
Catt and Rhinesmith 

Catt and Rhinesmith* 

DiPernat 

Kelly and Scafidi 


Figlio and Hart 
Rouse et al. 


Education Tax Credit Program 
School Scholarship Tax Credit 
Choice Scholarship Program/School Scholarship Tax Credit 


Choice Scholarship Program/School Scholarship Tax Credit 
Qualified Education Expense Tax Credit 

Academic Outcomes of Public Schools from All Empirical Studies 

Florida Tax Credit Scholarship Program 


Florida Tax Credit Scholarship Program 


Fiscal Effects on Taxpayers and Public Schools from All Empirical Studies 


Dearmon and Evans 
Lueken 
Lueken 


Lueken 


Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Lueken 
Girardi and Gullickson 
LOEDR¢t 
OPPAGAS$ 
Aud 

Aud 

Aud 


Oklahoma Equal Opportunity Education Scholarships 
Original Individual Income Tax Credit Scholarship Program 
Low-Income Corporate Income Tax Credit Scholarship Program 
Lexie's Law for Disabled and Displaced Students 

Tax Credit Scholarship Program 

"Switcher" Individual Income Tax Credit Scholarship Program 
Florida Tax Credit Scholarship Program 

Qualified Education Expense Tax Credit 

School Scholarship Tax Credit 

School Tuition Organization Tax Credit 

Educational Improvement Tax Credit Program 

Tax Credits for Contributions to Scholarship Organizations 
School Tuition Organization Tax Credit 

Florida Tax Credit Scholarship Program 

Florida Tax Credit Scholarship Program 

Original Individual Income Tax Credit Scholarship Program 
Educational Improvement Tax Credit Program 

Florida Tax Credit Scholarship Program 


*The report combined voucher and tax-credit scholarship parents into "Choice Parents," although anyone could calculate voucher and tax-credit 
scholarship results based on data tables in the report appendices. 


+The report combined voucher and tax-credit scholarship parents into "Choice Parents" for all information made publicly available. 
+ Legislative Office of Economic and Demographic Research (State of Florida) 
§ Office of Program Policy Analysis and Government Accountability (State of Florida) 
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New Hampshire 
Indiana 
Indiana 
Indiana 
Georgia 


Florida 2014 ‘| 
Florida 2013 
Oklahoma 


Arizona 
Arizona 


Arizona 


Arizona 
Florida 
Georgia 
Indiana 

lowa 
Pennsylvania 
Rhode Island 
lowa 

Florida 
Florida 
Arizona 
Pennsylvania 
Florida 
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Research Studies on Privately Funded Programs 


Test Score Outcome of Participants from Random Assignment Studies 


Bitler et. al. New York, NY 
Jin, Barnard, and Rubin New York, NY 
Cowen Charlotte, NC 
Bettinger and Slonim Toledo, OH 
Krueger and Zhu New York, NY 
Barnard et al. New York, NY 
Howell et al. Washington, D.C. 
Howell et al. New York, NY 
Howell et al. Dayton, OH 
Greene Charlotte, Ne 


Howell and Peterson Dayton, OH 
Howell and Peterson New York, NY 
Howell and Peterson National 


Howell and Peterson Washington, D.C. 
Peterson and Campbell National 
Greene Charlotte, NC 


Peterson, Campbell, and West] San Francisco, CA 
Peterson, Myers, and Howell San Antonio, TX 
Weinschrott and Sileore indianapolis, IN 


Gray, Merrifield, and Adzima San Antonio, TX 
Merrifield and Gray San Antonio, TX 
Diamond San Antonio, TX 
Greene and Forster San ADSI TX 


Carlson, Chingos, and Campbell} New York, NY 

Campbell Nationwide 

Bettinger and Slonim Toledo, OH 

Howell and Peterson Washington, D.C. 

Peterson and Campbell Nationwide 

Wolf et. al. Washington, D.C. 

Fiscal Effects on Taxpayers and Public Schools from All seal Studies 


Merrifield & Gray San Antonio, TX | 2009 | 
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[Medium: video file], retrieved from https://www.amazon.com/dp/BO7PD2T2YQ 


2. Greg Forster (2016), A Win-Win Solution: The Empirical Evidence on School Choice, 4th edition, 
retrieved from EdChoice website: http://www.edchoice.org/wp-content/uploads/2016/05/A-Win- 
Win-Solution-The-Empirical-Evidence-on-School-Choice.pdf 


3. Gertrude Stein (1993), Geography and Plays, p. 187, retrieved from https://books.google.com/ 
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Non-Cognitive Skills, https://dx.doi.org/10.2139/ssrn.3273422 


5. Emphasis added. What Works Clearinghouse (2014), Procedures and Standards Handbook: Version 
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year.png; University of Arkansas, Overall TOT Impacts by Year - US Voucher RCTs: Reading [Image 
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0.01 standard deviations translate to about seven days of learning. Center for Research on Education 
Outcomes (2015), Urban Charter School Study: Reporton 41 Regions, retrieved from Stanford University 
website: http://urbancharters.stanford.edu/download/Urban%20Charter%20School%20Study%20 
Report%200n%2041%20Regions.pdf 


8. R. Joseph Waddington and Mark Berends (2018), Impact of the Indiana Choice Scholarship 
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Policy Analysis and Management, 37(4), pp. 783-808, https://dx.doi.org/10.1002/pam.22086; David 
Figlio and Krzysztof Karbownik (2016), Evaluation of Ohio’s EdChoice Scholarship Program: Selection, 
Competition, and Performance Effects, retrieved from Thomas B. Fordham Institute website: https:// 
fordhaminstitute.org/sites/default/files/publication/pdfs/FORDHAM-Ed-Choice-Evaluation- 
Report_online-edition.pdf 


9, Patrick J. Wolf (2012), The Comprehensive Longitudinal Evaluation of the Milwaukee Parental 
Choice Program: Summary of Final Reports (SCDP Milwaukee Evaluation Report 36), retrieved from 
University of Arkansas Department of Education Reform website: http://www.uaedreform.org/ 
downloads/2012/02/report-36-the-comprehensive-longitudinal-evaluation-of-the-milwaukee- 
parental-choice-program.pdf 
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COMMITMENT TO METHODS 
& TRANSPARENCY 


EdChoice is committed to research that adheres to 
high scientific standards, and matters of methodology 
and transparency are taken seriously at all levels of our 
organization. We are dedicated to providing high-quality 
information in a transparent and efficient manner. 


The American Association for Public Opinion Research 
(AAPOR) welcomed EdChoice to its AAPOR Transparency 
Initiative (TI) in September of 2015. The TI is designed to 
acknowledge those organizations that pledge to practice 
transparency in their reporting of survey-based research 
findings and abide by AAPOR’s disclosure standards as stated 
in the Code of Professional Ethics and Practices. 


All individuals have opinions, and many organizations (like 


our own) have specific missions or philosophical orientations. 
Scientific methods, if used correctly and followed closely in 
well-designed studies, should neutralize these opinions and 
orientations. Research rules and methods minimize bias. 
We believe rigorous procedural rules of science prevent a 
researcher’s motives, and an organization’s particular 
orientation, from pre-determining results. 


If research adheres to proper scientific and methodological 
standards, its findings can be relied upon no matter who has 
conducted it. If rules and methods are neither specified nor 
followed, then the biases of the researcher or an organization 
may become relevant, because a lack of rigor opens the door 
for those biases to affect the results. 


EdChoice welcomes any and all questions related to methods 
and findings. 


BOARD OF DIRECTORS & OFFICERS 
Dr. Patrick Byrne, Chairman 

Fred Klipsch, Vice Chairman 
Lawrence A. O’Connor, Jr., Treasurer 
J. Scott Enright, Secretary 

Robert C. Enlow 

Dr. David D. Friedman 

William J. Hume 

Fred Reams 

Virginia Walden Ford 

Dr. Michael Walker 


ACHOICE 


111 MONUMENT CIRCLE 
SUITE 2650 
INDIANAPOLIS, IN 46204 
317 681 0745 


EDCHOICE.ORG 


